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ABSTRACT 

The National Instructional Television hea^.th series, 
"Ir\side/Out," is designed to assist eight-to-ten year old children 
and their teachers in dealing with their feelings about themselves, 
others, and the world around them. The programs are accompanied by 
classroom discussion. Three methods were used to test the 
effectiveness of "Inside/Out". They were 1) a specially designed 
classroom ob.'itervation system (used by trained observers) for 
measuring relevant categories of teacher and student discussion 
following the program viewing; 2) teacher and observer questionnaires 
dealing with teacher and student reaction to programs and discussion; 
and 3) in depth interviews with small groups of school children who 
had viewed programs in the series but not participated in classroom 
discussion. The first programs presented dramatic situations on the 
themes of expressing emotion, death, prejudice, amount of 
responsibility children were given. This volume of the evaluation 
presents summaries of results from observers* and teachers* 
questionnaires; the relation of teacher ratings of their classes* 
ability and socio-economic level to student understanding and 
appreciation of the programs; teacher attitudes toward affective 
learning; their reactions to the programs; and the effect of ^eacher 
participation in disr^ussioa on student participation in discussion. 
(JK) 
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T\\e National Instnictional Television health scries, ''Insidc/(Xit/' 
is designed to assist eight-to-ten year old diildren and their teachers in 
dealing with tlieir feelings alDout themselves, others, and tlic worhl around 
tlicm. 'Die programs in the series are but part of a large educational 
exi>erience tliat includes post-viewing activities, botli in and out of the 
classroom, as well as continual personal growth and development. 

ITiree metliods were used to test the effectiveness of ''Inside/(Xit'' in 
readiing its objectives. Tlie first was a specially designed classroor. 
observation system (used by trained observers) for measuring relevant 
categories of teadier and student discussion following tlie program vieiving. 
Two general areas were of interest, the referent of the discussions (film, 
self in relation Jo the film, self or self in relation to others, and others 
or concepts) and the mode of the discussions (cognitive domain, affective 
domain, or presentation of alternatives for coping with relevant situations). 
The instrument was designed to register dianges in the relative emphasis of 
these categories over time. 

Tlie second method was comprised of teacher and obsen^er questionnaires 
dealing with teacher and student reaction to programs and disajssions. 

llie third method used was in depth interviews with small groups of 
sdiool children who had viewed programs in the series, but not particii)atcd 
in classroom disaission. 

A total of eight programs (including alterriatc versions of three 
programs) were tested in ten geographically dispersed sites in late ^*:iy jpa: 
early June, 1072. One hundred and fifty-five classrooms, primarily of tl. 
3r(! and 4tb grades, were utilized. 



Results from the classroom observation system indicate that discussion 
in the affective areas is most prevalent, follo\\'ed first by the cofinitive 
domain and then by the presentation of alternatives. Tor both students and 
teachers, the percentage of discussion in the affective and cognitive 
domains declines slijjhtly over time (tliough the affective areas rcnain 
lushest throughout) and tl\e i)ercentaf;e devoted to presentation of alternatives 
increases. 

At tlie outset of tlie discussions both teacliers and students rely 
heavily on the program itself as a referent (60^ and snt. respectively), but 
the importance of the program as a direct referent declines steadily for 
to 20% and 18% respectively after 15 minutes of the interaction. Discussio;; 
dealing with the self and self in relation to others rises for both teachers 
cind students; more dramatically for the students who reach a 45 o level at 
20 minutes. Discussions dealing with others and concepts occupy about 35 ^> of 
the teaclier^s time during discussion, rising to a high of 40v. Students 
also readi peak of 40%, but begin with a low of 125. 

Reports of observers indicate tliat students become attentive to the 
programs quickly and remain attentive and orderly. Tliey are also attentive 
to disaissions and take an active role in them. 

Teadiers report tliat students like t}\e programs (54 v like them, 45"*. 
like tliem very much) and understand tliem (52?» understand tliem pretty well, 
41'v, clearly understand them). Ninety three per cent (93^0 of the classes arc 
reported to be comfortable witli a disaission of the topics dealt with in 
the programs. 

Forty eight per cent (48^) of the tcacliers reported that they foiiri. it 
easy to discuss the feelings and emotions in the programs, and 36?; found it 
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very easy. Ninety tv:o per cent {02?i) enjoyed workinji witli the proprains 
(42^ enjoyed it very imidi) and PS?, would like to work witli more. Forty five 
per cent (45p) of the participating teachers reported that the proRra^n tliey 
saw was superior to otlier educational television productions tliey had seen, 
and only 3% felt that the propran was of below average quality. 

llie attitude of tlic teacliers toward affective education in p.eneral was 
found to greatly affect the ease and enjoyment witli winch they used the 
"Inside/Out" programs, and tlieir desire to use furtlicr programs from the scries, 
llie degree of comfort with which the teachers approaclied the program discussioi^s 
also had a noticeable effect on the rate of student participation in tliose 
discussions. 

Some of the teachers were assisted by a teacher's guide. Use of the 
guide tends, in general, to promote discussions that are teacher directed, 
longer lasting, and lead to more student involvement than classrooms without 
a guide. 

'lliree of the programs tested liad alternate ending versions in whicli 
eitlier narrators or tlie actors themselves asked questions or made statements 
summarizing tne intent of the program and leading into discussion. 
Results of this evaluation indicate that prograjTis with summary statements or 
questions make teadiers more at ease, lead to more student involveiiicnt in 
and domination of discussions and promote longer discussions. Ihcse results 
seem to liold for tJie complex programs only, however. In tlie case of t^o 
program whose message was deemed relatively simple C'Livinji Mth Love") the 
alternate version ending led to shorter discussions. 

V.itli respect to certain programs, the following results are of special 
interest. 



7 



VI 1 

''How ]\> You Shoiv'*' is a very popular program because of tlie Iiiph t!cp,rce 
of activity and action involved, but tbc message of tbe program does not cone 
tlirougli clearly. Hie message must, in some way, be nade more exjUicit* 

•'IJut Names IVill Never Hurt'' was generally well received, but it is 
possible tliat it will attract less attention among students wliose priman' 
experience with prejudice is related to skin color and econonuc status 
rather than the language-nationality problem in the Canadian setting. 

Teadiers, relatively speaking, are less comfortable with "In TV 
Memory" than with the other programs, tliough a strong majority of the teadiers 
involved did enjoy working witli the program. Special care should be taken 
wlien using "In My Memory" to consider its effect upon children v/ho have 
recently lost a parent or sibling. 
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imOIXICTIOK 

Tlie National Instructional Television series "Inside/Oiit" represents 
an attempt to deal with an area of leaminp (and life) largely noRlected in 
tlie explicit curricula of American schools. IVhile cognitive learning goals 
and methods are constantly redefined and developed, affective education 
remains g^ierally inchc?ite. Affective education- -leaminp directed at tlie 
feelings and emotions--is the object of Inside/Out/' It is a health series 
in the broadest significance of the term. The National Instructional Television 
"Inside/Out" consortium adopts the position that no strict distinction should 
be drawn between body and mind; indeed, ^ is implicitly contMidod that the 
heal til of the child's body is intimately interconnected with the child's 
ability to understand and cope with feelings toward the self and toward a 
growing network of others. 

Tlie programs in the series are not assumed by National Instructional 
Television to be autonomous and self sufficient "shows." Rather, eadi 
program is considered but one part of a larger learning package which includes 
most iiH)ortantly the discussion subsequent to the broadcast. Furthermore, 
immediate one-to-one correspondence is not expected between any particular 
program and any specific behavioral change. Tlie anticipated learning is 
expected to resul*; fr<»n the ext«ided exposure to thirty programs and class- 
room discussions, plus the interaction, of this exposure with natural 
growth and development. 

Method. 



In terms of evaluation, the perspective outlined above creates 
difficulties if the evaluation is to take place while production is 
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continuing in the expectation that significant fecilback can be provided. 
Since tlie five programs (tl»ree in dual versions) became available just 
prior to the time of tlic evaluation, no consideration could be given to 
the long-term (one year or more) effects of "Inside/Oit.'' lioivever, one 
rather critical factor could be subjected to analysis, namely the assumption 
that the programs would not only stimulate discussion but stimulate 
discussion of a partiailnr sort- -centered initially on the prognun itself 
and rapidly moving toward the child's perception of how the program's thence 
found expression in his or lier am life. 

To find out wliat the actual cairse of the discussions would be, we 
chose to engage in direct observation of classroon process rather tlian rely 
entirely on subjective judgements. Observations were made on a specially 
k-xHified instrument keyed to tlie statement of objectives prepared by the 
National Instructional Television consultants. T\n'o observers in eadi class- 
room recorded the verbal behaviors of botli stulents and teaclier twice each 
minute. Four kinds of information were sought through the use of tlie 
instrument. First, the instrument differentiated three types of statements 
regarded as critically significant to the success of the discussions: 
cognitive, affective and alternative-regarding. For the purposes of this 
study, "cognitive" was defined as any statement centered on matters of physical 
fact and on statements which related to non-affective concepts. "Affective" 
statements contained some reference to feelings or emotions, wliether of the 
speaker himself or seme other. Tlie final category "alternatives" representclcl 
a subset of the other two. Any statement employing tlie future, conditional 
or subjunctive forms of discourse was scored as an "alternatives" statement. 
Both affective and cognitive matters could conceivably fall under tliis rubric. 
(See Part II, "Instructions for Observers" for a further explanation.) 
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Tlic second kind of information captured by the observation instrument 
was tlie referent of the statements made in the discussion by both stuilcnts 
and teadier. Four possibilities were allowed for: the program itself as 
referent, the speaker* s self in relation to the proRrajn, the self of the 
speaker in relation to others and, finally, others (with no reference to 
self) or abstractions. Special provision was made for cognitive statements 
whidi made specific reference to traditional health education topics. 

'file third kind of information sought was the relative contribution, 
in quantitative terms, of the students versus the teacher. For every tino 
unit, observers were asked to make a determination of the relative amount 
of time occupied by the comments of the teacher, on the one hand, and the 
students collectively on the other. 

Finally, all of the above factors were linked to time. V/e wished to 
determine tlie sequencing of tlie discussions. Over time, did the character 
of tlic discussions diange? It became possible to determine the relative 
significance of each of the aspects discussed above on a minute by minute 
basis. 

In addition to the direct observation instrument, three questionnaires 
were prepared for use by each of the two observers and the teadier in eadi 
classroom. Tlie observers questionnaire dealt witli the composition of the 
class, the attentiveness of the students and the style of the teadier *s 
approadi. Observers were also invited to share their subjective impressions 
of tlie class reactions to the program and the disaission. 

All participating teachers were asked to complete a questionnaire 
aimed at their reactions to the particular program they viewed and discussed 
witli their class as well as tlieir reactions to the utility of affective 
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education in general. Half of the teachers coniplctal a second questionnaire 
dealing with the teadier's guide. Hiese teacliers were those wlio hatl received, 
prior to the broadcast, a copy of the teaclier's guide in its tentative 
form. Since the nature of the guide was regarded by National Instructional 
Television as somewhat experimental, teachers' impressions of it were 
deemed essential information. 

'Die bulk of the evaluation effort was put in ol)serving the natural 
cruv^^rsroom use of the programs thraigh a variety of lenses. As a supplement., 
some 200 children were interviewed in small groups by a sympatlietic, non- 
teadier, adult outside the classroom, on the premise- that in-depth pursuit 
of questions might reveal certain aspects of the children's perception whicli 
would be undetected by the classroom obsen^ation process. rx)ndensed versions 
of those interviews appear in Part II of this report. 

In conclusion, it should be noted that, although care was taken by 
National Instructional Television to provide a representative sample when 
dioosing schools for this evaluation effort, the sample cannot be characterized 
as random. It is possible, therefore, that the data and interpretations 
are especially colored by peailiarities of the sami^le. Attempts have been 
made in this report to Iiighlight special diaracteristics of the sample 
whidi might affect the results, but it is not possible to gain the same 
sense of seairity in interpreting the results as one derives from a random 
sample. 
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Classroom Interaction Analysis, 

The following paragraplis describe the overall course of the 155 
classroom discussions whidi follaved the eight discrete programs tested 
(five programs, three of which were tested in dual versions), Tlie median 
length of discussion came at about the 15 minute mark wliile the 75th 
percentile falls at 20 minutes. The reported percentages represent tlie 
proportion of all observations at a given point in time which fall into 
the designated category. 

Tlie graphs which are included in this section arc smoothed versions 
of tlie graphs whicli appear in Part II of tliis report. Since tliey were 
smootlied manually, for the sake of legibility, they are somewhat inexact-- 
tlius tlie percentages reported in the text will not correspond precisely to 
the lines on tlie graphs. Tlie plots, however, do accurately represent the 
relationship and trends through time. Tlie data discussed below is a 
summarization of the observations of all observers for all classrooms for 
all programs. !)etailed graphs of the observations for each program (and 
program version) are available in Part II. 

Pilm-Sclf/Film-Self/Others-Others/Concepts. 
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At the outset of the disaissions, teachers foais heavily on the program 
itself. Tliis emphasis declines rapidly from 60% to 20?; at the 15 minute 
mark. Students, too, refer heavily to the program at first, their emphasis 
declining from 50% to 18% after 15 minutes. Tliroughout the discussion, 
teadiers make ^statements directly relating themselves to the program at a 
low and declining rate; 10% of their statements at the beginning, 5?. at 15 
minutes and 3% at 20 minutes might be categorized as relating the teacher 
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1^ to the cojccts, events and processes in the film. Student consents in tiic 

same category are similarly at a low level throiifiliout but decline more 

r 

L slowly over time; after an initial lugh of 19^, student self /film comments 

|- drop to 10% at 2h minutes and then to 8v at IS and 6-. at 20 minutes. 

For both parties tv*, tlie classroom process, tho proportion of statements 
I involving the self or the self in relation to otlier people increases as the 

discussion progresses. For students the increase is dramatically rapid; in 
tlie first seven minutes, the proportion increases from in^o to 301. Self/ 
others statenients from stulents continue to increase in relative frequency 
to a high of 45-0 at 20 minutes after which tlie re is a sliglit decline. Teachers 
increase their proportion of self/others statements from 10?; to 201 at 20 
minutes. Although teacliers become more prone to make self -related statements 
tlie longer the discussion lasts, their propensity to do so lags far behind 
their students. 

The f V il possibility provided by the observational instrument were 
statements .^rring to either abstractions or other people, things and 
feelings without any immedicate link to eitlier the program or the speaker* s 
self. For teadiers, this was an important class of statements from tlie 
third minute on. About one-tliird of all teadier conmxjnts through the 
^ 3. fifteenth minute fell in tliis category. After 15 minutes, the percentage 

rose to about 40% and remained steady through 30 minutes. It can be surmised 
witli a fair degree of confidence that tl\e bulk of tlie teachers* statements 
categorized as "others/concepts" are in the form of questions directed at 
the class. 

Students sharply increase the relative frequency of their statements 
in the other/concepts category over time, from 12% at the outset to 30% at 
0 minutes and to 40% at 20 minutes. 
H For both sutdents and^tcachers, it is quite clear that the films 
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serve as springboards for a discussion which is not tethered to the proprain 
itself* Talk about non-program matters dominates tlie teachers* comments 
after 9 minutes of disaission. Students make a similar shift two minutes 
earlier. By the twenty minute point, the relative importance of these 
categories of statements have stabilized for both students and tcacliers. 
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Cognitivc-Affectivc-Altcmatives. 

Turning to a second aspect of the classroom interaction analysis, the 
kind (or level) of discourse, wc discover patterns wlucl\ are stalilc throucjliout 
the course of the discussions for botli students and teachers. Statenonts 
of affect are more prevalent thaji cognitive statements wludi, in turn, arc 
more prevalent than statements which pose alternatives, lliis ordinal 
relationship holds up in the aggregate through approxinately 25 minutes, 
at whidi point virtually all discussions have terminated. 

At the beginning of the discussions, 45% of the teaclicrs comments arc 
classified as essentially affective in nature, and 40?; are cognitive, llicso 
percentages decline at the same rate to the 10 minute mark wliere they are 
at tlie level of 351 for affective, and 30% for cognitive, niose declines 
are matched by a gradually increasing empliasis upon alternatives statements 
which rise from 10% to 15% at 10 minutes. From tlie 10 minute point to tlic 
20 minute point, teadiers devote a constant 35% of their comments to affect 
wJiile cognitive statements continue to decline (to 25% at 20 minutes) and 
alternative statements continue to rise (tc 20% at 20 minutes). 

For students, too, affective statements predominate over cognitive 
and alternative statements tliroughout the disaissions. From a high of 501. 
at the very beginning, effective statements decline in relative importance 
to 40% after 5 minutes and remain approximately at that level for the 
remainder of the discussions. Cognitive statements comprise S?? of the 
student responses till the 10 minute point after wludi they decline to 
30% at 20 minutes. This decline matdied by a rise in significance of 
alternative statements. From a low of 10% at tlie beginning, alternative 
statements gradually increase to a proportion of slightly more than 15% at 
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20 minutes. 

In summary, the discussions between students and teaclicrs following'. 
tl\e eiglit tested "Inside/Out" programs are dominated l^y talk of an affective 
nature. Cognitive considerations become less and less important as the 
discussion wears on \Aile discussion of alternative behaviors l)ccomes more 
and more important. lIo\^ever, alternative statements are at every point \r\ 
time less prevalent than cognitive statements whicli arc less prevalent than 
affective statements. 
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RIISIILTS FROM 'iW. OBSI:RM:R (^Ur.«7riOmiRll 

In addition to rating the classroom discussions which followed 
viewing of the "Inside/Out" programs, ohservers were asked to record certain 
aspects of class and teacher behavior which might contribute useful infor- 
mation on the effectiveness of the series. The questions of the "Observer's 
iXssessment of 'Inside/Out' Discussion" are reproduced below alon.o, with 
results of value and interest. Complete computer tal)ulated results to these 
questions are included in Part II of this report. 

Observers were asked to note whetlier programs were viewed in blncK- 
and -white or in color. Of the 155 classrooms whidi participated in this 
evaluation effort, however, only seven viewed the programs in color. V.'itli 
such a small group of color viewers it was not useful to run any comparisons 
of black-and-white versus color viewers. 

(Questions In Order 

1. What was the class doing prior to tlie program? 

This question was included because it was felt that tyi^e of prior 
activity might have an effect upon class reaction to the programs. Tliis 
turned out not to be the case. Those interested in the answers to tliis 
question may find them in Part II of this report. 

2. now long did it take for the class as a whole to become attentive 
to the action of tlie screen? 

Fifty-six per cent (56%) of the classrooms became attentive before 

the first minute of the program had elapsed. Anotlier 28% became attentive 

by the close of the first minute, an additional 9% Ivy the close of the 

second minute, another 4% by tlie close of the third minute, and very near 1> 
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all of the classes were attentive by the tine that five minutes liail elapsed. 

3. To what extent did tlie title sequence attract their attention? 
Forty- two per cent (42%) of the observers said that title sequence 

strongly attracted the attention of their classes, 40?; said it mildly 
attracted attention, only 3% said it did not attract attention, and 15" 
could not tell. 

4. About what poicentage of the classroom was continually attentive 
to the program? 

Seventy-two per cent (72%) of the observers reported that 90% or 
more of the students in the class they observed were continually attentive 
to the program. 'ri>felve per cent (12%) of the observers reported that 80';, 
of tlie students were continually attentive. Six per cent (6%) of the 
observers reported 70% of the students were attentive, 5% reported 60% were 
attentive, and 5% reported that 50% or fewer of the students were continuall 
attentive. 

Students were most attentive to "I tow You S1W(91?. of observers 
reported 90% or better continual attentiveness) , and to "Must I, May I" (85? 
of obseivers reported 90% or better attentiveness). Students were least 
attentive to "In My Memory" (67% of observers reported 90% or better 
attentiveness) and "Names Will Never liirt" (61% of observers reported 90% 
or better attentiveness) . 

5. How many tims did the teacher have to re-establish order with 
one or more children during the program? 

Seventy-five per cent (75%) of the teachers did not have to restore 
order at any time. Fourteen per cent (14%) had to restore order once, 8% 
twice, and 2% three times. 

"Living With Love" encountered the most discipline problems, but this 
is a relative measure. Talicn by itself, it does not appear that the 
tcadicrs had a great deal of difficulty managing their classes. (See 
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"Observer and Teacher Comments from (Questionnaires" section of this report, 
hoivever, for notes on little boys' objections to displays of affection.) 

6. After the program ended, did the teaclier jiinediately begin 
discussing it? 

Tliis question turned out to be of little value. For results, see 
Part II of tl\is report. 

7. About wliat percentage of the class was continually attentive to 
the disaission? 

aiservers reported that in 33?i of tlie classes, OO?, or more of tlic 
students were continually attentive to the discussion. In another 17?, of 
the classes, 80% of the students were continually attentive. In 14% of 
the classes, 70% of the students were reported to he continually attentive. 
Sixty per cent (60%) of the students were attentive in ^% of the classes. 
In t]\e remaining 275 of the classes, 50-6 or fewer of the students were 
continually attentive to the disaission. 

"Must 1, May I" and "Mow Do You Sl\ow" were the programs which generated 
the greatest attentiveness to discussion. In each case 63?. of the observers 
reported 80% or better continual attentiveness to discussion. For the otl\er 
programs, from 41% to 47% of the observers reported 80% or better attentiveness. 

8. Al)out wliat percentage of the class actually took part in the 
discussion at least once? 

'Tlust I, May I" rates high on this question also. Forty-nine per 
cent (49%) of observers said that at least 70% of tlie class took part in 
the discussion at least once. Only 37% of "Flow Do You Slio\v'" observers 
reported 70% or better participation, however. The other programs ranged 
from 37% up to 40% of observers reporting 70% or better participation. 

Taking all the programs as a group, 41% of all oJxservers reported 70% 
or better class participation. Sixty-nine per cent (69%) of all observers 
reported 50% or better participation. 



23 



16 

9. Rate tlie teaclier on the following aspects during the tlisaission: 
Tense vs. Relaxed. (Six point scale) 

Six per cent (6-o) of observers reported tliat tenclicrs were "tense"' 
(left extrenie of scale), while 42 r reported that tliey were "rclnxecr' Criiiht 
extreme of scale). Seventy- five per cent (75*;.) of tlic teacliers were rated 
in the relaxed side of this six point scale. 

For some unknown reason '71ijst I, May teachers were reported as 
tlie most tense. Tliirty-seven per cent (37^0 of them were rated toivard the 
tense end of the scale, as opposed to only 24*6 of all teaclicrs from all 
prograirs . 

10. Rate the teadier on the following aspects during the discussion: 
Critical of students vs. Supportive to students. (Six point scale) 

Only l?>% of all teachers were rated on the "criticar* side of tliis 

scale. There were no noticeable differences among various programs. 

11. Rate the teacher on the following aspects during the disaission: 
Avoided subject of films vs. I-ngaged subject of films. (Six point 
scale) 

Only 16% of all teachers were rated on the avoidance side of this 

scale. 

Teadiers were least prone to avoid the subject during "How Do You 
SIiow" discussions. Eighty-one per cent (81%) of 'Ifow Do You Show" teacliers 
are rated at the "engaged'' extreme of tliis six point scale. For the other 
programs, this figure runs from 37?> ("Living V/itli Love**) to 53v ("Must T, 
May I"). 

12. tote the teacher on the following aspects during the discussion: 
Students dominated discussion vs. Teacher dominated discussion. 
(Six point scale) 

In general, discussions tended to be teacher dominated. Sixty-five 
per cent (65^d) of classrooms were ratal in the •'teadier dominated" half 
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of this six point scale, while 7>Si were rated in tlie ''student doninated" 
half. 

Tlie most interesting, result is that the long versions of all programs 
with two versions tend to gcncrato - ore student dominate'^ disaissions. Tliis 
result nay be seen if we divide t*- six point scale into two unequal parts, 
the first four for the ''student'' side, tlie last two for the "teacher" side. 
If we then compare versions for each proj^jain, we find tliat the disaissions 
generated by the short version of "In My • temor)'" are rated as 63?. student 
dominated, while the long version discussions are 71^6 student dominated. 
For "Living With Love" the comparable figures are 50^o and 73?i, and for 
"Must I, May I", they are 62-6 and 74%. The fact tliat all of these differences 
are in the same direction indicates a definite tendency for the long versions 
(those with questions at the close) to lead to greater student participation 
in discussions. 




RESULTS FROM THE TEACHER QUESTIONNAIRE 

Teachers were also asked to canplete a questionnaire concerning 
the program itself, the discussion viiich followed, and certain background 
characteristics of the students involved. These questions are reproduced 
below, once again with results of value and interest. Conplete conqputer 
tabulated resxilts to these questions are included in Part II of this 
report. 

Questions In Order 

1. How would you rate the intellectual ability of your students 
as a group? 

Teachers rated 13% of all classes as above average intellectual 
ability, 82% as average, and 5% as below average. Classes viewing 
"In Vfy Memory" had the higjiest percentage rated as above average (32%) . 

2. How would you rate the socio-economic level of your students 
taken as a groi^? 

Teachers rated 10% of all classes as high socio-economic level, 
78% as middle socio-economic level, and 13% as low socio-economic level. 
Qasses viewing version two of "In ivfyr Memory" had the highest percentage 
rated as high socio-economic level (56%) . Qasses viewing version one 
of "In Ify Manory'' had the greatest percentage rated as low socio- 
economic level (38%). 

Results from the above two questions were crosstabulated against 
understanding and appreciation of the programs. Results may be found 
in another section of this report. 
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3. Did your students like the program? 

Forty-five per cent (45%) of the students liked the program "very 
much," 54% "liked" them, and 2% "disliked" them. Only 8% of students 
viewing "In My Memory" liked it 'Very much," but none "disliked" it. 

4. Did your students understand the meaning of the program? 
Forty-one per cent (41%) of the students "clearly understood" the 

program they viewed, 52% 'tmderstood it pretty well," 7% "had a vague 
understanding," and only one classroom "did not understand it." Teachers 
reported that 13% of the classes which viewed "Living With Love" had only 
a "vague understanding" of the program. 

5 . Please comment on elements which they understood well or did 
not understand. 

See "Observer and Teacher Conments from Questionnaires" section 
of this report for these extracted comments. 

6. Were the students comfortable with a discussion of feelings 
and emotions? 

Thirty-five per cent (35%) of the classes were "very comfortable," 
58% were "comfortable," and 8% were "uneasy." 

"In M/ Memory" caused the greatest discomfort. TWenty per cent 
(20%) of teachers working with this program reported that their students 
were "uneasy." This was true of 17% in the case of "Living With Love," 
version two. 

7. Were the students more involved in this discussion about the 
program than they usually are in other classroom discussions? 

Teachers reported 5% of all classes as "much more involved," 26% 

as '!more involved," 55% as "about the same," and 13% as "less involved." 
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"How Do You Show" and "In ^^fy Memory," version two, came out best 
on this question. "How Do You Show" teachers reported 48% of their 
classes as '•more involved." "In Nly Manory," version two, teachers re- 
ported 22% of their classes as "much more involved," and 334 as "more 
involved." "Living With Love," version two, suffered most from this 
question. Twenty-three per cent (23%) of these teachers reported their 
classes as "less involved," and 9% reported "much less" involvement. 



I 8. How often do you discuss the topics of feelings and emotions 

with your class? 



Forty per cent (40%) of all teachers disaiss feelings and emotions 
"often," 52% discuss them "on occasion," 8% discuss them "rarely," and 
one teacher "never" discusses these topics. 

This question was included to provide background infoiroation on the 
classes involved with the "Inside/Out" evaluation. Crosstabulations of 
this question with other questions are reported in another part of this 
report. 

I 9. Did you find it easy or difficult to discuss the feelings and 

emotions involved in this program? 

I Thirty- six per cent (36%) of all teachers found it "very easy" to 

discuss the affective content of the program they viewed. Forty-eight 

L per cent (48%) found it "easy," and 17% found it "somewhat difficult." 

J- "In My Memory" gave teachers the most trouble. Thirty-six per cent 

(36%) of these teachers reported it "somewhat difficult" to discuss the 

1^ emotions involved with death. 

10. Did the program itself make it easier for you to discuss 
^ these feelings and emotions? 

Thirty-two per cent (32%) of all teachers reported that the program 

£ they watched made it 'tauch easier" to lead a discussion. Sixty-three per 

r 
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cent (63%) said the program made it "somewhat easier," 4% said the program 
made it "more difficult," and 1% reported the program made it "much more 
difficult." 

An interesting result is that in all cases where there are two 
versions, the first, or short, version fares better on this question. 
For "In i^fy Memory," version one, 31% of the teachers involved report that 
the program made it "much easier" to discuss the feelings and emotions 
involved. In ttie case of version two, the long version, only 11% of 
the teachers report that the program made the discussion 'Wich easier." 
For "Living With Ix)ve" the comparable figures are 60% aiid 26% and for 
"Must I, May I" they are 58% and 7%. 

11. Did you enjoy working with this program? 

Forty-two per cent (42%) of all teachers "enjoyed very much" working 
with their program. Another 50% "enjoyed it," while 8% "did not enjoy it.' 
Relatively speaking, "In My Memory" provides the least enjoyment to the 
teachers. Only 20% of these teachers report that they "enjoyed it very 
much," while 16% "did not enjoy it." 

12. Would you like to work with more programs dealing with the 
topics of feelings and emotions? 

Ninety- five per cent (95%) of the teachers answered that they would 

like to work with more programs dealing with feelings and ^notions. 

13. Was this discussion teacher-directed or student-directed? 
Twenty-five per cent (25%) of all teachers reported that their 

discussions were "nearly all teacher directed." Another 57% said that 
the discussion was "more teacher directed than student directed." Six- 
teen per cent (16%) of all teachers reported that their discussion was 
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••more stxident directed than teacher directed/' and only 3% reported 
that the discussion was •'nearly all student directed." 

This question was cross tabulated against question 12 in tlie ob- 
server questionnaire, "Rate the teacher on the following aspects during 
the discussion: students dominated discussion vs, teacher dominated 
discussion (six point scale) • There was a noticeable degree of agree- 
ment between observer and teacher answers to these questions, and a 
chi square analysis (^X^) indicated that this degree of agreement could 
have occurred fewer than five times in a hundred by chance. 

It was reported above that analysis of observer ratings on ob- 
server question 12 indicated that version two of all programs which had 
two versions led to student dominated discussion. This was not the 
case with teacher ratings^, avever. Teacher reports indicate that 
program version makes little difference as to whether students or 
teachers dominate the discussions. 

Teacher reports of this question do indicate, however, that "In 

My Memory" leads to more student domination of discussion. TWenty-four 

per cent (24%) of "In Ify Memory" teachers reported that their discussion 

were "more student directed than teacher directed," while this was true 

of only 16% of the teachers taken as a vAole. 

14. Is learning about and discussing the feelings and emotions 
useful to students? 

This question was used to gather background information on 

teachers , and answers were crosstabulated against answers to other 

questions on the observer and teacher questionnaires. Results of this 

procedure are reviewed in another part of this report. 
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Overall, 59% of the teachers feel that discussing feelings and 
I emotions is 'Very helpful,'* 40% feel that it is "helpful,'* and only one 

teacher feels that it is "not helpful.'* 
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15. During the school year, have your students been introduced 
to the topics of feelings and emotions? 

This was another question used to gain background information on 

the classes involved in this evaluation. Results were not particularly 

useful. 

Among all teachers, 46% reported their classes were introduced to 
feelings and emotions '*often,*' 48% "occasionally," 6% "rarely," and 
one teacher reported "never." 

16. Was the vocabulary in this program suitable for the students 
I in your class? 

Two teachers reported that the vocabulary in the programs was 

; 1: "too advanced." All others reported that it was '^suitable.*' 

C17. Judged against other educational television productions you 
have seen, was this program superior, average, or below average? 
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Forty-five per cent (45%) of the teachers reported that their 
program was "superior," 52% said thait it was "average," and 3% said 
"below average." 

"Must I, May T' received the highest rating. Fifty-five per cent 
}^ (55%) of the teachers ranked it as "superior." "Living With Love" re- 

ceived 50% "superior" rankings, "How Do You Show" received 46% "superior," 
"In My Memory" received 38% "superior," and "But Names Will Never Hurt" 
received 33% "superior" rankings. 

18. Was the music in this program appropriate or inappropriate? 
J TWenty-four per cent (24%) of the teachers felt the music was 
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•Very appropriate," 72% felt it was "appropriate," and 4% felt it was 
"inapproriate." 

The music was most popular in "Living With Love." Forty-three 
per cent (43%) of the teachers involved felt the music was 'Very 
appropriate." The music in "How Do You Show" was also well received, 
with 34% of the teachers rating it as 'Very appropriate." •'Must I, 
May I" recorded 14% 'Very appropriate," "But Names Will Never Hurt" 
recorded 13%, and "In My Manory" recorded 5% 'Very appropriate." 

19. In your professional judgment, was this program with dis- 
cussion a successful lesson? 

The program with discussion was rated 26% of all teachers as 
'Very successful," by 66% of all teachers as "successful," by 7% of all 
teachers as "unsuccessul," and by one teacher as 'Very unsuccessful." 

20. Were there any portions of this program that were inappropriate 
or educationally ineffective? 

See "Observer and Teacher Conments from Questionnaires" section of 
this report for these extracted conments. 

21. Were there any portions of this program that appeared to be 
particularly effective or meaningful? 

See "Observer and Teacher Comments from Questionnaires" section of 

this report for these extracted conments. 

22. How often are your students exposed to educational films and 
instructional TV? 

Answers to this question did not prove to be of much value to our 

analysis. 

23. Do you have any suggestions for improving this program and 
ones like it? 

See "Observer and Teacher Comments from Questionnaires'* section of 
this report for these extract ed conments. 
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RELATICN OF TEACHER RATING OF CLASS ABILITY AND 
SOCIO-ECCNOMIC LEVEL TO STUDENT UNDERSTANDING 
AND APPRECIATION OF THE PROGRANB 

Ideally, the "Inside/Out" series should have equal iii5)act on 
students of all levels of intellectual ability and socio-economic back- 
ground. Practically this cannot be the case. In order to get some 
idea of the differential iJipact of the series on students of varying 
backgrounds, teachers were asked to rate their students, as a group, 
on intellectual ability and socio-economic level. Results of these 
ratings were then run against results on the questions, "Did your 
students like the program?" and, "Did your students understand the 
meaning of the program?" 

Results indicate that students of lower intellectual ability like 
the programs more, but tend to understand them less. These relation- 
ships are not strong, however^ and lO^ analysis indicates a 25% probability 
that they occurred by chance. Nevertheless, the results are consistent. 
Thirty-two per cent of the "above average" classes liked the programs 
"very much," while 46% of the "average" classes and 57% of the "below 
average" classes fell in this category. When we move down from "liked 
it very much" to "liked it," we find 68% of the "above average" classes, 
52% of the "average" classes, and 43% of the "below average" classes. 

It is evident from these figures that even though there are slight 
and consistent differences among classes of varying intellectual ability, 
there is a hi^ level of appreciation for the programs among all classes. 
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VAlUOl ."How would you rate the intellectual ability of your students 

taken as a proup?" 
VAR103 "Did your students like the program?" 
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The results of the crosstabulation between class intellectual 
ability and understanding of the series are less consistent. Sixty- 
eight per cent (68%) of the "above average** classes "clearly understood" 
the program and 37% of the "average" classes "clearly understood" it. 
But 43% of the "below average" classes also were rated "clearly under- 
stood." (There were only seven *TDelow average" classes vfliich increases 
I the impact of individual cases which may not fit broad patterns . ) Moving 

to "somewhat understood," we find 32% of the "above average" classes, 
55% of the "average" classes, and 57% of the "below average" classes 
|- Eight per cent (8%) of the "average" classes "vaguely understood" the 

program. 

) Socio-economic level seems to be strongly related to understanding 

the programs and somevdiat related to appreciation of the programs. Stu- 

n 

I . dents of higher socio-economic level understand the programs more (^2 

I • indicated this result could occur by chance only one time in a thousand) , 

^ and like them less {X^ indicates this result could occur one time in ten 

J by chance) . 
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Seventy-nine per cent (79%) of the •'high" socio-economic level 
classes clearly imderstood the programs, while this was true of only 39% 
of the "middle" and 28% of the "low" classes. Rated as "sanewhat under- 
stood" were 14% of the "high" classes, 55% of the "middle," and 61% of 
the "low." 

Thirty-six per cent (36%) of the "high" socio-economic level classes 
like the program "very much," vrtiile this was true of 48% o< the "middle" 



/ j-r clcLises and 39% of the "low" classes. Fifty-seven per cent (57%) of the 

i 

I "high" classes "liked it," while 52% of the "middle" classes and 56% of 



0 

^ tlic "low" classes were in this category. 
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VAR102 "How would you rate the socio-economic level of your students 

taken as a group?" 
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VAI1102 "How would you rate the socio-economic level of your students 

taken as a group?" 
VAIilOS "Did your students like the program?" 
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r TEACHER ATTITUDES TGVARD AFFECTIVE LEARNING AND 

TEACHER REACTIONS TO "INSIDE/OUT" PROGRAMS 

[ 

The effectiveness of the "Inside/Oxt" series depends both upon 
1^ the quality of the programs themselves and upon the manner in which they 

are used by the teachers. The manner in which the teachers treat the 
programs will depend in great measure upon the teacher's basic attitudes 
I' toward affective learning as a part of the curriculum* 

In order to gaiii some idea of how the teachers felt about affective 
[_ learning, they were asked, "Is learning about and discussing feelings 

and emotions helpful to students?" Answers to this question were then 
crosstabulated with several other questions relating to the program 
with which the teacher dealt. 

One of these other questions was, "Did you find it easy or diffi- 
; [ cult to discuss the feelings and emotions involved in this program?" 

: Among those vrtio felt that learning about feelings and emotions was "very 

: helpful," 43% found it "very easy" to work with the program, and 41.7% 

\ p tbund it "easy." Among those who felt that learning about feelings and 

i emotions was "helpful," only 24% found it 'Very easy" to work with the 

j: program and 59% found it "easy." The computed on this crosstabulation 

indicated that these results could have occurred by chance only five 
times in a hundred. 

A second question was, "Did you enjcy working with this film?" 
Among those vdio felt learning about feelings and emotions was 'Very 
helpful," 56% enjoyed working with the program 'Very much." Among those 
who felt learning about feelings and enotions was just "helpful," only 
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VA1U14 "Is -learning about and discassing feelings and emotions helpful 
to students?" 

\'AIU09 "Did you find it easy or difficult to disaiss the feelings and 
emotions involvc<l in this program?" 
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25% enjoyed working vath the program 'Very much." Only 3.51 of those 
viio felt learning about feelings was 'Very helpful" did not enjoy 
working with the program, while 14% of those v4io felt learning about 
feelings was "helpful' • did not enjoy working with the program. The 
confuted on the crosstabulation frcm vMch these figures are drawn 
indicated that these results could have occurred by chance only one time 
in a thousand. 

A third question was, "Would you like to work with more programs 
dealing with the topics of feelings and emotions? Only seven teachers 
said that they would not like to work with more , and all of them had 
answered that learning about feelings is '"helpful" rather than "very 
helpful." The computed on this crosstabulation indicated that the 
probability of chance occurrence of this result was only five in a 
thousand. 

A fourth question was, "Were the students comfortable with a 
discussion of feelings and anotions?" Forty-two per cent (42%) of those 
who had said that learning about feelings was "Very helpful" said that 
their stud^ts were "very comfortable," while this figure was only 24% 
for those \iho said such learning was "helpful." Forty-nine per cent 
(49%) of those \iio had said that learning about feelings was 'Very helpful" 
reported that their students were "comfortable," while 69% of those who 
had said learning about feelings was "helpful" • reported their students 
as ""comfortable." analysis indicated that there was less than a 
25% chance that these results could occur by chance. 
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VA1U14 "Is lenminp about and discussing feelings and emotions helpful 
to students?" 

VAIQ06 "Yierc the students comfortable with a discussion of feelings and 
emotions?" 
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VAR114 "Is learning about and disaissing feelings ni\d emotions helpful 
to students?" 

VAR112 "Would you like to work with more programs dealing with the topics 
of feelings and emotions?" 
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Finally, the teachers were asked, "How often do you discuss the 
topics of feelings and emotions with your class?" Fifty-one per cent 
(51%) of those who had said that learning about feelings is "very helpful" 
reported that they discussed feelings with their class "often," while 
this figure was only 25% for those who had said that learning about 
feelings was just "helpful." Forty-three per cent (43%) of the teachers 
vdio had said that learning about feelings is "very helpful" reported that 
they discussed feelings with their students "on occasion," while this 
figure was 65% for those who had said that such learning was "helpful." 
The for this crosstabulation could have occurred by chance only once 
in a thousand times. 

As a measure of the effect of previous classroom experience upon 
student reactions to "Inside/Out," answers to "How often do you discuss 
the topics of feelings and emotions with your class? was crosstabulated 
with answers to "Were the students confortable with a discussion of 
feelings and emotions?" Forty-six per cent (46%) of the teachers who 
discussed feelings with their students "often" reported that their 
students were "very comfortable" with the "Inside/Out" discussion, while 
only 28% of the teachers who discussed feelings with their students 
"on occasion" reported this result. Only 2% of the teachers who "often" 
discussed feelings with their classes said that their students were 
"uneasy" with the "Inside/Out" discussion, while this was the case with 
11% of the teachers who only discuss feelings with their classes "on 
occasion," and 20% of the teachers who "rarely" discuss feelings. 

analysis indicated that these results could have occurred less than one 
time in ten by chance. 
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I£ we assume that answers to, "Is learning abcait and discxissing 
feelings and emotions Ipful to students?" indicate teacher attitudes 
which existed prior to viewing an "Inside/Out" program, then it is clear 
that prior opinions o£ teachers have a marked inpact on their attitudes 
toward the series. The fact that there is a high degree of association 
between this question and "How of ten do you discuss the topics of feelings 
and motions with your class?" indicates that we probably are dealing 
with a pre-existing attitude. 

But even if teacher attitudes toward affective education are, in 
part, formed through exposure to the "Inside/Out" series, the fact 
remains that these attitudes will have a great effect upon series 
utilization, and quality of utilization. 
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"Is learning about and discussing feelings and emotions helpful 
to students?'' 

''How often do you discuss the topics of feelings and emotions 
with your class?" 
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VAR108 "How often do you discuss the topics of feelings and emotions with 
your class?" 

VAR106 "Were the students comfortable with a discussion of feelings and emotions 
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Tini LPFLCT OP TlJVCIDiR PHlFORflANCn IN niS(llSSlO\' 
UPON S'niDHNT PARTICIPATION IN DISCUSSION 

Classroom observers were requested to rate participating teachers 
on several six point continua describing the teadicr's classroom behavior. 
Among these continua were: Tense vs. relaxed, critical of students vs. 
supportive to students, and student -dominated disaission vs. teacher- 
dominated discussion. ITie results on these continua scores were then 
crosstabulated against observer ratings of tlio percentage of students in 
each class which actually took part in the discussion at least once. T!ie 
results on each of these crosstabulations strongly indicate that the 
behavior of the teacher has a great effect on t\\o percentage of children 
\ I who will take part in an "Inside/Out" discussion. 
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Tlie X statistic was computed for eadi crosstabulation. In each case, 
an association was found \^uch could have occurred by chance only once in 
a thousand times. In other words, there can be little doubt that the 
associations found in these crosstabulations resulted from interaction 
between the factors investigated, and not by diance. 

The results indicate tliat relaxed and supportive teachers promoted 
greater participation in tlic discussion, and tcadiers who tended to allac 
the students to dominate tlic disaission promoted greater participation. 

For example, from among tliose classes in which the teacher was rated 
as very tense, 60^a had a student participation rate of 30^"- or less, \<\\ lo 
only 19^ had a student participation rate of 70^^ or nore. I^it among tlior.o 
classes in which the teacher was rated as very relaxed, ot. v IIC, had • 
student participation rate of 30?; or less, while S\% had a student parti- 
cipation rate of 705; or more. 
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^\inong those classrooms in which the tCtidier was rated as very 
critical, 64t. l\ad a participation rate of 30^. or less, wlule 7^0% had a 
participation rate of 70% or more. AmonR those cl«assroons in wliich tl\e 
teacher was rated as very supportive, only 12?. has a student participation 
rate of 3Q% or less, while 50% had a rate of 70% or more. 

Ivhen observers indicated by their rating that students dominated the 
discussion, only 8% of the classes had a participation rate of 30% or less, 
while 75% had a participation rate of 70% or more. !^t when observers 
rated the teachers as daninant in tlie discussion, 49% of such classrooms hj 
a participation rate of 30% or less, while only 20% had a student parti- 
cipation rate of 70% or more. 
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VAR009 "Rate the teacher on the follcndng aspects during tlie discussion." 
CTense— Relaxed) 

VAR008 "^o^Jg^^'^jat^gg^ficntaRC of the class actually took part in the disaission 
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VAU009 "Rate the teadier on the follojving aspects during the discussion.' 

(Critical of students- -Supportive to students) 
VAR008 "About vfhat percentage of the class actually took part in the 

discussion at least once?" 
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VAR012 "Rate the teadier on tlic following aspects during tlie discission 
(Students dcaninated discussion- -Teaclicr daninated disaission) 

VAR008 ''About wliat percentage of the class actually took part in tlie 
discussion at least once?" 
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TMa--R's GiJinr 



Although the evaluation was not designed pririarily to measure the 
impact of the teachor's guide on teacher and student attitudes and 
behavior, certain questions evoked rather divergent responses from guide 
users as opposed to non-guide users. Approximately lialf of tlie teadiers 
were provided with the preliminary edition of tlie teacher's guide; the 
actual number v/ho both liad the guide and responded to tlie questionnaire 
was 70. Seventy- seven teachers without a guide available to them also 
responded. 

Teachers \dth guides were slightly more prone to describe their 
pupils as 'Very comfortable" in the disaission of feelings and emotions. 
They were also slightly more likely to describe them as "uneasy." The 
non-guide teachers rated their students as "comfortable" more often tlian 
guide teadiers. This somewhat confusing result (wliich incidentally is 
Statistically significant at the .10 level, X test) may he attributable 
to the greater deliberateness induced by the guide. Mien the guide is 
used, tcacliers may be more prone to "follow the script," a tactic which 
may in some cases be very successful or may be very unsuccessful, but in 
any case is less likely to produce tlie essentially neutral response at 
"comfortable." 

Indeed, guide teachers reported tliat their students were more involved 
than usual in the post-program discussions. Twenty per cent (20%) of the 
non-guide teachers reported either "much more involvement" or "more 
involvement"; the guide teachers reported 42% in the same two categories, 
(Significance level of .10, test.) According to the records of 
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discussion duration submitted by the classroom observers, 37?; of the puidc 
classrooms held discussions exceeding 20 minutes in length Khilc only 21 r» 
of the non-guide classrooms held comparably long discussions. 

By tl\e accounts both of the teachers themselves and the observers, 
10% more of the guide-equipped classrooms were dominated by the teacher 
in the discussions rather than the students. 

The message is quite clear. Provision of a teacher's guide arms the 
teadier to conduct longer, more directed discussions. 
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GIOTJVPIIIC IjOGMK^N A.Nn PTACT OF "laiT NAMES WILL Nm;R IJIRr' 

Tlic Canadian setting of the program on prejudice, "I\it Names Vill 
Xever l!urt" is unfamiliar to most .American school scliildren, as is the 
conflict between /\njilo-Canadians and French-Canadians. For this reason 
it is important to speailate upon the impact of this program in areas 
where cliildren are more familiar with prejudice involving other racial 
and etlinic groups. 

Since tJie program was tested both in Toronto and in San Jose, it 
offered an opportunity for measurement of impact in "familiar" and 
"unfamiliar" territory. We might expect that students in Toronto would be 
more familiar with the problems depicted in the program than students in 
San Jose who would more likely be exposed to racial tension involving 
blacks, Qucanos, and whites. Tlius Toronto students might be alue to 
better understand the program tlian San Jose students. 

We examined tlie teacher and observer questionnaires from these two 
test sites, crosstabulating test site with every question on eadi 
questionnaire. A clii square (X^) was run on eadi resultant table. Tlie 
probability of chance occurance of these chi squares will be reported in 
the following text. 

Hie results are somewliat confusing, there being apparent disagreement 
between teadier and observer assessments of what occurred. With respect 
to background factors, tliere were no significant differences in teachers' 
assessments of class intellectual capabilities or social-economic level in 
tlie two cities. Teadier ratings in the two cities further indicated no 
significant differences in degree of student understanding of the program. 
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liking for the program, or being comfortable with a discussion of the 
feelings and emotions in the prograin. Neither were tliere any significant 
differences when the teachers in the two cities rated themselves on 
wliether tliey foimd it easy or difficult to disaiss the feelings and 
emotions in the prograjn, and wliether or not the program made it easier 
to disajss these feelings. 

Ohscn^er assessments in the two cities indicated, however, that 
classes in San Jose took more time to become attentive to the program 
(p=.001), were less continually attentive to the prograin (p<.25), and 
that teachers in San Jose had to re-establish order more often (p< .2S). 
During the disaissions following the program, classes in San Jose were 
less attentive (p< •005), percentage of class participation was less 
(p< .25), teadiers were more tense (p< .05), and teachers tended to be 
more dominant (p < . 25) . 

Surprisingly, teachers in Toronto were more likely than teachers in 
San Jose to say that their stutlents were 'less involved" in the 'Inside/ 
Out'' discussion than in other classroom disaissions. 

It is difficult to say with assurance why classes in San Jose were 
less attentive to the program and disaission than those in Toronto. On 
otlier counts, San Jose students should have done just as well or better 
than Toronto students. San Jose students discuss emotions and feelings 
more often than do Toronto students (p<.10) and are exposed more often to 
T T V thiol Toronto students (p=.05). Perhaps there is a difference in the 
way tlic two scliool systems administer discipline, or porliaps the relative 
tenseness of tlie teadicrs in S-m Jose was a cause rather than an effect 
of student inattention. 
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l^ut we do liave strong suspicions tliat the reason for the difference 
between the two cities is the inability of San Jose students to understand 
and relate to tlie Canadian ethnic and geographic setting. 

Teadiers in San Jose were prone to make critical conments on the 
geographic and ethnic setting of "Riit Xames Will Never Iliirt" and to suggest 
that the use of different racial and socio-economic situations would help 
their students' understanding and appreciation of tlie pTogram. (See 
"Observer and Teacher Comments from (^lestionnaire" section of this report.) 
Toronto teachers made several comments that their students could not 
understand the Ottawa-IIull situation, and one coimicnted that the students 
did not understand language as a source of prejudice. But this type of 
comment was less prevalent among Toronto teachers than among San Jose 
teachers, and Toronto teachers did not suggest the use of Chicanos and 
blacks to illustrate prejudice. 

In summary then, teadier answers to most questions showed no 
significant differences in student appreciation and understanding of the 
program in the two cities, but San Jose teacliers were prone to suggest that 
the ethnic and geographic setting was not appropriate for San Jose students. 
Oliserver answers indicated that San Jose students were less attentive to 
program and discussion than were Toronto students. There is good reason 
to suspect that the relative inattentiveness of San Jose students was due 
to their inability to identify with the Canadian situation. 
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i)iPFii!uiN'ci:s i.>.mivi;i;.\ program versions 

lliree of tlie five programs included in this evaluation were produced 
in r^'o sliglitly different versions: "Must I, May I,'' "Living With Love," 
and "In :v Memory." In the alternate versions (also referred to as version 
2 or the augmented version) the sound-track plus freeze-frames focussed 
the central concern of the. program in the closing minute of tlie program. 
The question posed by NIT is wlietlier version 2 u-ould he more effective in 
stimulating the teacher and the class into a meaningful discussion. The 
following analysis of data aitegorized by program version may slied some 
light on the question. (See Part II, "Program Version Differences," for 
support ing st at i s t i cs . ) 

Generally the responses to the observers' and teachers' questionnaires 
reflected little difference between versions. The variations disaissed 
beloiv are for the most part not statistically significant, i.e., there is 
a liig]i iirobal)ility that tlic same result could liave occurred by cliance. 

In My Memory. 

According to the data submitted by the classroom observers, tlic 
augmented version of "?'temory" elicited somewhat less participation in 
discission from viewing diildren than the shorter version. Ten per cent 
more of tlie short version classrooms had participation rates higher tlian fin?;. 

However, the teachers were reported as more relaxed in discussing 
version 2 than version 1; on a six-point scale ranging from "Tense" (n) 
to "Relaxed" (6) , 83?; of the version 2 teadiers fell into categories 5 and 
fi comi)arcd to 6n?i of tlie version 1 teadiers. At the same time, the version 
2 tcacliers were more likely to avoid the central theme of the program-- in 
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j this case the reality of a family death in the life of a 3rd or 4th grade 

^ cliild. Dichotomizing at the midpoint of a six-point avoidance-engaRement 

L scale, ZO^i of the version 2 teachers fell on the "avoided subject" end 

compared to 13% for the version 1 teadiers. 

I 

Version 1 teachers, spealcing for themselves and their experience with 
I' t^^e programs, were more prone to say that the program made it easier to 

discuss the emotions and feelings related to death, ihis result may in part 
I be attributable to some teachers' greater willingness to say that they 

found the theme of death generally difficult to tackle in discussion. 

According to teadiers' reports students "liked" both versions equally 
p well, yet there remain some interesting differences in student response. 

Fewer version 2 classroom observers reported the teadicr as the dominant 
} influence in the discussion. Twenty-nine per cent (295) of the version 2 

J- classrooms were reported at the two most extreme values of the teacher end 

' - of a six point "teacher dominated -student dominated" discussion scale. 

|; In contrast, 37% of the short version (version 1) classrooms were reported 

as teadier- dominated. Bolstering this finding, tcacliers report that the 
j ; children viewing version 2 understood tlie program better and were more 

involved in the discussion than the children who saw version 1. Tlie version 
> • 2 diildren were also reported by their teachers as somewhat more ill-at- 

|1 ease than the version 1 watchers, a plausible enough result given the 

higlily diarged nature of the progvar.i's subject. 
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Living With Love. 

Like "In My Memory," tlie lengthier version of "Living With love' 
provoked somewhat less participation in discussion than did the short 
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version. Ntore children took part in tlie disaission followinp the version 
lacking the pointed ending: 62% of the version 1 classrooms had partici- 
pation rates of 60% or higher as opposetl to 451 of the version 2 classrooms. 

Again, as in the case of "In My Memory," the classroom observers 
report the teachers in long version classrooms in the aggregate as soncwhat 
more relaxed. About 10% more of the version 2 teachers than version 1 fell 
into the two most extreme (relaxed) categories of a six point "tense- 
relaxed" scale. Teacliers in both groups were equally able to come to grips 
with tlie central content of the program as measured by the "avoidance - 
engagement" scale. 

Although, by the teachers' account, pupils viewing and discussing 
each version were, in general, equally favorable to the program, version 2 
students were both slightly more at ease and slightly less invoh'ed in tlie 
discission than their version 1 counterparts, lliirty per cent (30%) of 
the long version classrooms were described as "very comfortable" in 
discussion of "Living With Love" feelings and emotions, compared to 13?; 
for the short version. Tliirty two per cent (32%) of the version 2 class- 
rooms were less involved in the discussion than usual compared to 7% for 
version 1 classes. 

Perhaps as a result of the higher degree of involvement of the short 
version classes, teachers of these classes felt that their students 
understood the meaning of the program more than the version 2 classes. 
l\vo-thirds of the version 1 teadiers claimed that their classes "clearly 
understood" the program; version 2 teachers made the same claim only one- 
third of the time. (This difference is statistically significant at the 
.10 level, test.) 
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Not only did version 1 classes understand bettor, but the teachers 
regarded version 1 as ratlier more helpful in leading into a disaission of 
the key feelings and emotions. Sixty per cent (CM) of the version 1 
teadiers said the program made it "much easier" to discuss the relevant 
feelings; for version 2, the comparable figure is 26%. 

Must I. May I. 

Tlie degree of s'aident participation in discussion provoked by the 
alternate versions of "Must I, Hay I" is equal. Tliis is in contrast to 
"In My Memory" and "Living With Love" where the augmented version had a 
lower participation rate than the unadorned version. 

For this program, teadiers were more likely to come to grips with 
the program theme following a viewing of version 2 than version 1. 
Seventy three per cent (73%) of the version 2 teadiers and only 46?^ of 
the version 1 teachers were found at the two most extreme values (engagement 
end) of the six-point "avoided subject- engaged subject" scale. 

Teachers tended to dominate the discussion less with the alternate 
version. For version 1, 38.4'fi of the classrooms were reported by observers 
as a 5 or a 6 on a six-point teacher domination scale. For version 2, the 
corresponding statistic is 26.6?u. Tliis jibes nicely with the report by the 
teadiers that 44% of the version 2 classrooms were more involved than 
ordinarily in the post-viewing discussion. T!ie figure for the version 1 
classroons is 25%. 

At the same time that teadiers are indicating greater student 
involvement in discussion, they also report that the shorter version of 
the program 1.) promotes greater ease among the students, 2.) is liked by 
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the students more, and 3.) is understood more by the students. 
Summary , 

The differences between versions as reflected in the reports of tlie 
observers and the questionnaire responses of teachers are equivocal taken 
as a whole, althougli certain tendencies are quite clear. 

1. ) In two out of three cases, the alternate ending version was 
associated with lower student participation rates. A larj^er perccnta,r,e 
of students took part in the discussions following tlic short version. 
In the third case C'^fust I, ^tay I") there was no difference in 
participation rates. 

2. ) Tcadiers were clearly less tense, according to the classroori 
observers, in discussing version 2 than in disaissing version 1. 

3. ) Although tlie proportion of students participating in discussion 
is lower with 2 than with 1, teadiers play a less p'J^'ominent role in 
the version 2 discussion. 

4. ) \ccording to tlie teachers, students "like'* botli versions equally 
well. In tlie teachers* view, the short version of "Living With I.ovc" 
and "Must I, May I" arc "understood" better than the extended version. 
'Hie opposite is the case for "In My ^•emory." 

5. ) Teachers report that students arc less at ease in discussion 
follaving version 2 of "In fly Memory" and "'^ust I, May I," and norc 
at ease following version 2 of "Living With Love." 

ft.) For all three programs, higher proportions of version ^ tl;nn 
version 2 teachers see the program as a help in discussing the 
partiailar feelings central to the program. 



58 



Coinmcnt, 

For all three dual version programs, the alternate ending versions 
put the teachers more at ease and give the students a larger role in 
directing the discussion. 

For two of tlie three programs (''Living With Love" is the exception) 
students are reported by their teachers as more involved in the disaissions 
than their version 1 counterparts and, as a consequence, the discussions 
run considerably longer. For these same two prograjns teachers report 
that their version 2 students are less at ease in discussion. Iliis is 
very likely a result of their higlier involvement and is consistent Kith 
the concept of the series. For "In My Memory" and "Must I, ^lay I" the 
alternate ending appears to be a significant asset. Tl)e "tag" at the 
end apparently provided otherwise untrained, uncoadied teacliers and 
students the base from which to launch a significant discussion. A 
thorough and wide-reaching utilization and training program may eliminate 
the advantage provided by tlie alternate versions of these two programs. 

"Living Witli Love," version 2, also sets the teadier more at ease 
and permits the students a larger role in shapinj^ the discussion. 
However, the students are reported as being less personally involved in tlu^ 
ensuing discussion, and the disaissions themselves are shorter for 
version 2 than version 1. lliis result, inconsistent with the findings on 
tlie other two alternate programs, may be due either to the nature of ti-c 
production (e.g., it is oudi less narrati^'e than "In My Memory" and "Must 
I, May I") or to peculiarities of the particular clnssrooiis wluch were 
designated to view "Living Witli Love." V/e are inclined to tliink the nnoiu)! 
results from a combination of these two factors. 
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LILNGTII OF niSaiSSION RY PR(r,PvAM 



'Hie median Icngtli of the post-program discussions was approximately 
15 minutes. The programs differed considerably in the ajnount of discussion 
they stimulated or rather, in the ajiiount of disaission they were permitted 
to stimulate by the classroom teacher. The longest disaissions arc 
associated \>dth "Names V/ill Never Ifurt," the shortest with "In ^!y Memor)'," 
version 1 (sl\ort). Seventy four percent (74'o) of tlie classrooms viewing 
"Names Will Never I\jrt" held disaissions lasting longer than fifteen 
minutes; the comparable figure for "In My Memory," version 1, is 19%. Tl;o 
augmented version of "In My Memory" was accompanied hy somewhat longer 
discussions- -over half of the discussions (57*0 lasted beyond 15 rdnutes. 
A similar, althougli lesser, difference nay be noted between the two 
versions of "flust I, May I." Wiile 35% of the discussions of the short 
version lasted past 15 minutes, 41-0 of the alternate version lasted that 
long. 

Tlie differences between the two versions of "T.iving With hove" wore 
in tl\e opposite direction. Tl\e sliortcr version produced lengthier 
discussions than the augmented version. Forty- seven percent (47^) of the 
sliort version discussions went past 15 minutes; 34 of the long version 
discussions went past the 15 minute mark. 

"Mow Do You Sliow," available in only one version, prahiced relatively 
short discussion periods; 23% exceeded 15 minutes compared to the across- 
progran\ average of 43%. Only 6% of tl\ese discissions were beyond 20 
minutes. Over one-fourth (26.4%) of all discissions follwing all j^roju' tn: 
exceeded 20 minutes. 
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In summary, longer discussions arc associated witli tlic alternate 
ending versions of ''In My Memory'' and "Must I, May I." The alternate fomi 
of "Living Witli Love" was follou'cd by shorter disaissions than the version 
minus the "tag." "Xamcs Will Never Ifiirt" and "How Do You Sliow" were 
follovs'ed by the longest and shortest discussions, respectively, of all tlie 
programs . 

Altliough the nature of the evaluation design precluiles any straiglit- 
forward attribution of causality, tlie data presented above (and in table 
form on the folloiving i)age) in combination with knowledge of the programs 
tlieniselves, are suggestive of a pattern. Hie two alternate versions (of * In 
My Memory" and "Must I, May V) relative to tlieir counterparts, and "Names V.i 
Never Iliirt" relative to all programs and versions of programs are more 
successful in generating discussions, lliese three programs sliare two 
things: first, they are each conceptually complex and, second, eacli has a 
fairly didactic closing sequence. ITie remaining programs, "How Do You Sliow'* 
(without a didactic close) and "Living IVith Love" arc both conceptually 
simple. Given this simplicity, "How Do You Show" generated sliort discussions 
and "Living Kith Love" was not improved by the alternate ending. 

ITie implication is that for complex programs (wliether or not they 
deal with "sensitive" topics), some fairly overt ending wliich defines the 
issues is likely to facilitate disaission. Less difficult programs arc 
not lielpcd by such endings and may even be slightly liarmed. 
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UHGIW OF DISCUSSION BY PUOGRA.M* 
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I: 



COUNT 
ROK PCT 
COL PCT 
TOT PCT 

TIMELAPS 

^..00 
FIVE MINUTES 



PROGNUM 

1 NAMES IHOW 00 1 
NOT HURT YOU SHOW 
l.OOI 3.001 



IN MY 2 
MEMORY 
5.001 



IN MY I 
MEMORY 
6.001 



li 



5-id 



10-15 



15-20 



20-25 



MORE T. 25 




COLUMN 
TOTAL 



*Timclaps: Length of discussion 

Progmim: Program, A "1" prior to the title indicates a short version^ A **2" indicates an alternate 
ending version. 




aJ?M^RY OF TAPI; PJlCORDHn INTF.RViraVS MTII SCITOL ailLDRHN 



TIic following arc salient points whicli were gleaned from tape 
recorded conversation witli 3rd and 4th grade cliildren in the Pittsburgli 
l\iblic Schools and in the North Allegheny Sdiool District, north of 
Pittsburgh. Tlie prograras sham were ''Mow Do You Sliow. "In fty ^temor>'/' 
**?:tist I, May I/' and "Rit :iaiTies Will Never I!urt.'' Tiie prograins were 
shov%'n in pairs; ''Itow I\) You Sliow../* with^'In fty i^fernory," and '^liist I, Vay 
V uith ''But Xames IVill Xever IMrt." Two classes, a 3rd and a 4th, smc 
each pair in the North Allegheny School District. Tn Pittsburgh, a 4th 
grade class watched "But Names Will Never Ilurt," and a 3rd grade class 
watched "In fty Memory." 

The condensed versions of these conversations are included as an 
appendix to this report. Tliese conversations differ from tlie other 
classroom observations included in this report in that the teachers v.ere 
not involved and an attjmpt was made to make the discussions as little 
observer -directed as ]^ossible. Tlie conversations were held witli small 
groups of cliiUdren (4 to 7) in a spot isolated from the rest of tlie 
class. Croups were mixed; some were all boys, sopkj all girls, and some 
mixed. 

It should be rememl^ered tliat students registered their comments on 
tlie tape recorder directly after viewing the programs, and without the 
benefit of a classroom discussion. ITie results of these interviews, tlien, 
should provide both an indication of the strength of "Inside/Out" programs 
in the event of poor classroom disaission or the absence of classroom 
discussion, and an indication of wliat teachers should clarify for their 
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students in discussion. 
Must I, r;ay I. 

Tlie most intelligent children in tliese discussion groups got tlie messngc 
of tliis program witli little diffiailty, but those of average or less 
intelligence (based upon the disaission leaders sul^jective impressions) had 
some difficulties. 

Many of tlie children missed tlie point tliat the program was about 
seeking and accepting tlie proper amount of responsibility in the process of 
growing up. Tliey gatliered that the little boy had too little to do, and the 
girl had too mucli. But they tended to moralize about this situation: the 
little boy shouldn^t talk back to his mother, the girl shouldn't complain or 
shirk her responsibilities, the two should diange places for a while to see 
how they like it. 

Most children failed to see that the little boy rebelled against his 
mother because he wanted more responsibility. They characterized him as 
spoiled, lazy, and unappreciative . 

Many children thought that because the two stories went on simultaneotisly 
the two children were going to meet. Tlie excessive noise and traffic in the 
city and the frequent mention and use of bicycles led them to believe an 
accident was going to occur, perhaps involving both children. Several said 
tliat for a long time they thought they were watching a ''safety film." 

'llie movement back and forth between tlie girl's and boy's story annoyed 
some cliildren, but most understood the purpose of tliis tedinique. >tost all 
the children understood that the little boy was happy to be asked to deliver 
a prescription, but some criticized him for not being more careful with the 
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package. Many children also thought tlie little boy intended to steal 
something in the dmgstore. 

Tliere was soine confusion about where tlie little girl's mother was, 
although this was verbalized in tl.c program. 

But N-amcs Will '.'ever Hurt. 

Most children have little tiifficnlty grasping what this program is 
all about. Tliey can relate the story, remember fine details, anil with 
probing can realize that both boys display prejudice at some point in the 
program. Tliey also understand that prejudice is more than just dislike for 
someone, and that it involves classes of people. Hie problems whidi we 
discovered with tlus program are problems of detail. 

First, tl\e diildren cannot relate flag burning, mard\ing in the 
streets, and other sud\ historic examples of prejudice to their om 
experience. Tliese scenes do not make an impact, and lend some minor 
confusion. 

Tliere is som confusion as to where Mark lives and v^iat his nationality 
is: France, America, Oliio...? There is also some confusion about the two 
parts of Ottawa and wliere Mark has gone when he is in Hull. 

It is unclear whetlier the French-Canadians in Hull do not speak 
linglish to Mark out of inability, misunderstanding, or prejudice. If this 
ambiguity was intended, tliere is no problon. If a clear message was 
intended, it was not received. 

In My Memory. 

"In My Memor/" is a very moving production. IJoth teachers and students 
watch closely and many diildren and their teachers come close to tears. 
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Itoivever, when discussing the program afterwanl, the children tend not to 
verbalize their feelings too well. Most commonly, they say that they are 
sad, and they relate experiences r.hout grandparents or nets who have died. 
Althouj'h tliey can obviously feel .Mdness, and state that they are sad, 
they have difficulty abstracting oir experience and suggesting how one 
ought to deal witli death. Many do rerncTnlicr, however, that the notlier in 
the program said that the dead live in o\ir memories. 

IVith enough probing, the cliildrcn rericmber the father's analogy 
relating the life process to the flower, and the mother's statement that 
it is all right to cry together. It nay be the case that at this age 
children have not really learned to repress feelings of sadness, so that 
the program is merely a reaffirmation of their behavior. 

Boys are critical of this program because they feel that it lacks 
action. Tliis is especially tnie of boys who previo\isly viewed "I'oiv Ho 
You Sliow." Both boys and girls sometimes criticize the program because 
it is too soiTber, and there is too mich crying. 

Die father's beard did not arouse mud\ comment, tliough several 
cliildren did not care for it. 

The children feel that a ten year old slioiild know more about deatli 
and sho\ild realize that Grandma will never return. It is perhaps for this 
reason tliat some of the children believe that linda is 7 or 8 rather than 
10 or 11. 

Teachers have their own criticism of "In My Memory." Tliey feel that 
it leaves the impression that only old people die, and thus fails to give 
a true picture of the reality of dcatli. 
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How Do You Sliow. 

This is a very popular program, especially with little boys, because 
of the action and excitement it contains. But the message gets through 
only with difficulty, and sometinjes not at all. Altliough the theme song is 
catching and the meaning obvious to adults, children tend not to remember 
the words, or if they do, not to relate tlie words to the events in the 
program. 

The children do not catch the title, wliicli further hinders under- 
standing of the program. In fact, the discussion leaders also missed the 
title. In the print used for the tests, it must have been absent or 
obscure for some reason. 

Some of the girls like this program as well as the boys, but others 
have difficulty relating to it at all. Unfortunately, a conversation with 
five girls whidi best illustrates this point was lost due to a malfunction 
of the tape recorder. But the gist of the lost conversation was that the 
girls didn't like the program because: boys shouldn't fight, they shouldn't 
go through the cemetery, they shouldn't play in garbage cans, they shouldn't 
eat cake when their mother told them not to, and little girls don't like 
baseball. TIius, for a certain segment of the population of 3rd and 4th grade 
girls, this program is "male chauvinist.'* 

If tliis program is to achieve effectiveness along with its popularity, 
sometliing must be done to clearly alert the diildren at an early stage 
that tliis is a program about expressing feelings. 



67 



